Display device and method of controlling the same

ABSTRACT

A display device, including a content receiving unit configured to receive a high dynamic range image, an image processing unit configured to detect a first region whose luminance value is equal to or greater than a reference luminance value within the high dynamic range image and perform tone mapping on an image of the first region based on feature information of the image of the first region, and a display unit configured to display a low dynamic range image on which the tone mapping is performed.

CROSS-REFERENCE TO RELATED APPLICATIONS

This application claims the benefit of Korean Patent Application Nos.10-2014-0134135 and 10-2015-0024271, filed on Oct. 6, 2014 and Feb. 17,2015, respectively, in the Korean Intellectual Property Office, thedisclosures of which are incorporated herein by reference.

BACKGROUND

1. Field

Embodiments relate to a liquid crystal display with a heat generationunit to preheat a liquid crystal display panel and a driving methodthereof.

2. Description of the Related Art

In general, a luminance of the actual world is known to have a dynamicrange of 100,000,000:1. Also, a contrast range that can be distinguishedby a human's eyes, that is, a dynamic range of a human's eyes, is knownto be about 1,000:1 to 10,000:1. A dynamic range of cameras according tothe newest technology is known to be about 10,000:1.

On the other hand, a liquid crystal display panel, a plasma displaypanel, an organic light emitting diode panel, and the like widely usedas display devices have a dynamic range of about 100:1 to 1000:1.

That is, a dynamic range of images that can be output from displaydevices is narrower than a dynamic range that can be distinguished by ahuman's eyes and a dynamic range that can be detected by a camera or thelike.

In this manner, an image having a dynamic range greater than a dynamicrange of an image that can be output from a general display device iscalled a high dynamic range (HDR) image. In contrast to the high dynamicrange image, an image having a dynamic range equal to or less than adynamic range of an image that can be output from a general displaydevice is called a low dynamic range (LDR) image.

When the high dynamic range image is input from such an image source,the display device performs an operation of converting the high dynamicrange image into a displayable dynamic range. Such an operation iscalled “tone mapping.”

Tone mapping methods in the related art include a method in which anentire dynamic range is compressed and the high dynamic range image isconverted into the low dynamic range image, a method in which the highdynamic range image is directly displayed on a display device having alow dynamic range and the like.

However, according to the method in which the entire dynamic range ofthe high dynamic range image is compressed, there is a problem in thatbrightness of the image output from the display device significantlydecreases compared to an original image.

Also, according to the method in which the high dynamic range image isdirectly displayed on the display device having a low dynamic range,there is a problem in that an image of a luminance, which is unable tobe displayed on the display device, is not displayed.

SUMMARY

Additional aspects and/or advantages will be set forth in part in thedescription which follows and, in part, will be apparent from thedescription, or may be learned by practice of the embodiments.

There are provided a display device and a method of controlling the samethrough which an image displayed on a display device can maintainbrightness of an original image without change, and image informationincluded in a high luminance region can be displayed.

According to an aspect of the disclosed embodiments, there is provided adisplay device, including: a content receiving unit configured toreceive a high dynamic range image and luminance information of the highdynamic range image; an image processing unit configured to perform tonemapping based on the luminance information such that the high dynamicrange image is converted into a low dynamic range image; and a displayunit configured to display the low dynamic image, wherein the luminanceinformation includes a maximum luminance value and a minimum luminancevalue of the high dynamic range image.

The luminance information may include a maximum luminance value and aminimum luminance value of the high dynamic range image included in ascene.

The luminance information may include a maximum luminance value and aminimum luminance value of the high dynamic range image forming a frame.

The luminance information may include a maximum luminance value and aminimum luminance value of the high dynamic range image included inentire content.

The image processing unit may detect a first region whose luminancevalue is equal to or greater than a reference luminance value within thehigh dynamic range image, and perform tone mapping on an image of thefirst region based on feature information of the image of the firstregion; and the feature information may include at least one of edgeinformation, texture information and gradation information of the highdynamic range image.

The image processing unit may detect an edge region within the image ofthe first region and generate a first mapping function based on ahistogram of pixels included in the edge region.

The first mapping function may have a gradient that is changed accordingto the number of pixels included in the edge region.

In the first mapping function, a gradient of luminance values at whichthe number of pixels included in the edge region is great may be greaterthan a gradient of luminance values at which the number of pixelsincluded in the edge region is small.

The first mapping function may be a cumulative histogram obtained byintegrating a histogram of pixels included in the edge region.

The image processing unit may detect a texture region within the imageof the first region and generate a first mapping function based on ahistogram of pixels included in the texture region.

The image processing unit may detect a gradation region within the imageof the first region and generate a first mapping function based on ahistogram of pixels included in the gradation region.

The image processing unit may generate a second mapping function basedon a luminance value of the high dynamic range image.

The image processing unit may perform second tone mapping according tothe second mapping function on the high dynamic range image, and performfirst tone mapping according to the first mapping function on the imageon which the second tone mapping is performed.

The image processing unit may generate a second mapping function basedon a luminance value of a second region whose luminance value is lessthan the reference luminance value within the high dynamic range image.

The image processing unit may generate a tone mapping function based onthe first mapping function and the second mapping function, and convertthe high dynamic range image into the low dynamic range image accordingto the tone mapping function. The image processing unit may performlinear tone mapping on a first pixel whose luminance value is less thana reference luminance value among a plurality of pixels included in thehigh dynamic range image, and perform nonlinear tone mapping on a secondpixel whose luminance value is equal to or greater than the referenceluminance value among the plurality of pixels.

When a scene average luminance value of the high dynamic range imageincluded in a scene is less than a reference luminance value, the imageprocessing unit may perform linear tone mapping on a first pixel whoseluminance value is less than the reference luminance value among aplurality of pixels included in the high dynamic range image and performnonlinear tone mapping on a second pixel whose luminance value is equalto or greater than the reference luminance value among the plurality ofpixels.

When a scene average luminance value of the high dynamic range imageincluded in a scene is equal to or greater than a reference luminancevalue, the image processing unit may perform linear tone mapping on afirst pixel whose luminance value is less than the scene averageluminance value among a plurality of pixels included in the high dynamicrange image and perform nonlinear tone mapping on a second pixel whoseluminance value is equal to or greater than the scene average luminancevalue among the plurality of pixels.

According to another aspect of the disclosed embodiments, there isprovided a method of controlling a display device, including: receivinga high dynamic range image and luminance information of the high dynamicrange image; performing tone mapping based on the luminance informationsuch that the high dynamic range image is converted into a low dynamicrange image; and displaying the low dynamic image, wherein the luminanceinformation includes a maximum luminance value and a minimum luminancevalue of the high dynamic range image.

The luminance information may include a maximum luminance value and aminimum luminance value of the high dynamic range image included in ascene.

The luminance information may include a maximum luminance value and aminimum luminance value of the high dynamic range image forming a frame.

The luminance information may include a maximum luminance value and aminimum luminance value of the high dynamic range image included inentire content.

The performing of the tone mapping may include: detecting a first regionwhose luminance value is equal to or greater than a reference luminancevalue within the high dynamic range image, generating a tone mappingfunction based on feature information of an image of the first region;and performing tone mapping on the high dynamic range image according tothe tone mapping function in order to convert the high dynamic rangeimage into the low dynamic image. The feature information may include atleast one of edge information, texture information and gradationinformation of the high dynamic range image.

According to an aspect of the disclosed embodiments, there are provideda display device and a method of controlling the same through whichdifferent tone mapping functions are used for a high luminance regionand a low luminance region, and thus an image displayed on a displaydevice can maintain brightness of an original image, and imageinformation included in a high luminance region can be displayed.

According to another aspect of the disclosed embodiments, there isprovided a method of controlling a display device, including determininga first region of an image having a luminance higher than a secondregion of the image, determining first and second mapping functionscorresponding to the first and second regions, where the first mappingfunction enhances one or more image features and the second mappingfunction increases brightness, and mapping the image using the first andsecond mapping functions responsive to luminance to preserve brightnessof the image of the second region and preserve feature information ofthe image of the first region.

BRIEF DESCRIPTION OF THE DRAWINGS

These and/or other aspects of the embodiments will become apparent andmore readily appreciated from the following description of theembodiments, taken in conjunction with the accompanying drawings ofwhich:

FIG. 1 illustrates an exterior of a display device according to anembodiment;

FIG. 2 illustrates a control configuration of a display device accordingto an embodiment;

FIG. 3 illustrates an exemplary image processing unit included in adisplay device according to an embodiment;

FIGS. 4A-4B illustrate an exemplary operation of linearizing image databy an image processing unit included in a display device according to anembodiment;

FIG. 5 illustrates an exemplary original image;

FIG. 6 illustrates a luminance histogram of the original imageillustrated in FIG. 5;

FIG. 7 illustrates an example in which the original image illustrated inFIG. 5 is partitioned according to a luminance value of a pixel;

FIG. 8 illustrates an exemplary image obtained by partitioning theoriginal image illustrated in FIG. 5 according to a luminance value;

FIGS. 9A-9B illustrate another exemplary image obtained by partitioningthe original image illustrated in FIG. 5 according to a luminance value;

FIGS. 10A-10B illustrate an example in which the image processing unitillustrated in FIG. 3 extracts a feature point from a first region;

FIGS. 11A-11B illustrate an example in which the image processing unitillustrated in FIG. 3 generates a first mapping function based on afeature point of a first region;

FIGS. 12A-12B illustrate another example in which the image processingunit illustrated in FIG. 3 generates a first mapping function accordingto a feature point of a first region;

FIGS. 13A-13B illustrate an example in which the image processing unitillustrated in FIG. 3 generates a second mapping function based on animage of a second region;

FIG. 14 illustrates an exemplary tone mapping function generated by theimage processing unit illustrated in FIG. 3;

FIGS. 15A-15B illustrate a result obtained when a display device of therelated art performs tone mapping on a high dynamic image;

FIGS. 16A-16B illustrate a result obtained when a display deviceaccording to an embodiment performs tone mapping on a high dynamicimage;

FIG. 17 illustrates an exemplary high dynamic range image displayoperation of a display device according to an embodiment;

FIG. 18 illustrates another exemplary image processing unit included ina display device according to an embodiment;

FIGS. 19A-19B and 20 illustrate an example in which the image processingunit illustrated in FIG. 18 generates a tone mapping function;

FIG. 21 illustrates another exemplary high dynamic range image displayoperation of a display device according to an embodiment;

FIG. 22 illustrates another exemplary image processing unit included ina display device according to an embodiment;

FIGS. 23A-23B illustrate an example in which the image processing unitillustrated in FIG. 22 performs tone mapping on an image of a firstregion;

FIGS. 24A-24B illustrate an example in which the image processing unitillustrated in FIG. 22 performs tone mapping on an image of a secondregion;

FIG. 25 illustrates another exemplary high dynamic range image displayoperation of a display device according to an embodiment;

FIG. 26 illustrates another exemplary image processing unit included ina display device according to an embodiment;

FIG. 27 illustrates a third mapping function generated by the imageprocessing unit illustrated in FIG. 26;

FIG. 28 illustrates another exemplary high dynamic range image displayoperation of a display device according to an embodiment;

FIG. 29 illustrates another exemplary image processing unit included ina display device according to an embodiment;

FIGS. 30 and 31 illustrate a fourth mapping function generated by theimage processing unit illustrated in FIG. 29; and

FIG. 32 illustrates another exemplary high dynamic range image displayoperation of a display device according to an embodiment.

DETAILED DESCRIPTION

Reference will now be made in detail to the embodiments, examples ofwhich are illustrated in the accompanying drawings, wherein likereference numerals refer to the like elements throughout. Theembodiments are described below by referring to the figures.

Embodiments described in this specification and configurationsillustrated in drawings are only exemplary examples of the disclosedembodiments. The embodiments cover various modifications that cansubstitute for the embodiments herein and drawings at the time of filingof this application.

Hereinafter, an embodiment will be described in detail with reference tothe accompanying drawings.

FIG. 1 illustrates an exterior of a display device according to anembodiment. FIG. 2 illustrates a control configuration of a displaydevice according to an embodiment.

A display device 100 is a device that may process an image signalreceived from the outside and visually display the processed image.Hereinafter, a case in which the display device 100 is a television (TV)will be exemplified, but the present embodiment is not limited thereto.For example, the display device 100 may be implemented in various typessuch as a monitor, a mobile multimedia device or a mobile communicationdevice. A type of the display device 100 is not limited as long as adevice visually displays an image.

As illustrated in FIGS. 1 and 2, the display device 100 includes a mainbody 101 that forms an exterior of the display device 100 andaccommodates various components of the display device 100.

A stand 102 supporting the main body 101 may be provided below the mainbody 101. The main body 101 may be stably disposed on a plane by thestand 102. However, the present embodiment is not limited thereto, butthe main body 101 may be installed on a vertical surface such as a wallsurface by a bracket or the like.

A button group 121 configured to receive a user control command from theuser and a display panel 143 configured to display an image according tothe user control command may be provided in the front of the main body101.

Also, various components configured to implement functions of thedisplay device 100 may be provided in the main body 101. A controlconfiguration illustrated in FIG. 2 may be provided in the main body101.

Specifically, the display device 100 includes an input unit 120configured to receive the user control command from the user, a contentreceiving unit 130 configured to receive content including an image anda sound from an external device, an image processing unit 200 configuredto process image data included in the content, a display unit 140configured to display an image corresponding to the image data includedin the content, a sound output unit 150 configured to output a soundcorresponding to sound data included in the content and a main controlunit 110 configured to overall control operations of the display device100.

The input unit 120 may include the button group 121 configured toreceive various user control commands from the user. For example, thebutton group 121 may include a volume button for regulating a magnitudeof a sound output from the sound output unit 150, a channel button forchanging a communication channel through which the content receivingunit 130 receives content, a power button for turning power of thedisplay device 100 on or off and the like.

Various buttons included in the button group 121 may use a push switchconfigured to detect the user pressing, a membrane switch or a touchswitch configured to detect contact of a part of the user's body.However, the present embodiment is not limited thereto, but the buttongroup 121 may use various input methods that can output an electricalsignal corresponding to a specific operation of the user.

Also, the input unit 120 may include a remote controller that receivesthe user control command from the user remotely and transmits thereceived user control command to the display device 100.

The content receiving unit 130 may receive various pieces of contentfrom various external devices.

For example, the content receiving unit 130 may receive content from anantenna configured to wirelessly receive a broadcasting signal, aset-top box configured to receive a broadcasting signal in a wired orwireless manner and appropriately convert the received broadcastingsignal, a multimedia playback device (for example, a DVD player, a CDplayer or a blu-ray player) configured to play content stored in amultimedia storage medium and the like.

Specifically, the content receiving unit 130 may include a plurality ofconnectors 131 connected to the external device, a receiving pathselecting unit 133 configured to select a path through which content isreceived from among the plurality of connectors 131, a tuner 135configured to select a channel (or a frequency) through which abroadcasting signal is received when the broadcasting signal is receivedand the like.

The connector 131 may include a coaxial cable connector (an RF coaxialcable connector) configured to receive a broadcasting signal includingcontent from the antenna, a high definition multimedia interface (HDMI)connector configured to receive content from the set-top box or themultimedia playback device, a component video connector, a compositevideo connector, a D-sub connector and the like.

The receiving path selecting unit 133 selects a connector through whichcontent is received from among the plurality of connectors 131 describedabove. For example, the receiving path selecting unit 133 mayautomatically select the connector 131 through which content has beenreceived or manually select the connector 131 through which content willbe received according to the user control command of the user.

The tuner 135 extracts a transmission signal of a specific frequency(channel) from various signals that are received through the antenna andthe like when the broadcasting signal is received. In other words, thetuner 135 may select a channel (or a frequency) through which content isreceived according to a channel selecting command of the user.

The image processing unit 200 processes image content in the contentreceived by the content receiving unit 130 and provides the processedimage data to the display unit 140.

The image processing unit 200 may be a computer and may include agraphic processor 201 and a graphic memory 203.

The graphic memory 203 may store an image processing program for imageprocessing and image processing data, or temporarily store image dataoutput from the graphic processor 201 or image data received from thecontent receiving unit 130.

The graphic memory 203 may include a volatile memory such as an SRAM ora DRAM and a non-volatile memory such as a flash memory, a read onlymemory (ROM), an erasable programmable read only memory (EPROM) or anelectrically erasable programmable read only memory (EEPROM).

For example, the non-volatile memory may semi permanently store theimage processing program for image processing and the image processingdata. The volatile memory may temporarily store the image processingprogram and the image processing data loaded from the non-volatilememory, the image data received from the content receiving unit 130 orthe image data output from the graphic processor 201.

Also, the non-volatile memory may be provided separately from thevolatile memory and form an auxiliary memory device of the volatilememory.

The graphic processor 201 may process the image data stored in thegraphic memory 203 according to the image processing program stored inthe graphic memory 203. For example, the graphic processor 201 mayperform image processing such as image linearization and tone mapping tobe described below.

While the graphic processor 201 and the graphic memory 203 have beenseparately described above, the present embodiment is not limited to acase in which the graphic processor 201 and the graphic memory 203 areprovided as separate chips. The graphic processor 201 and the graphicmemory 203 may be provided as a single chip.

Detailed operations of the image processing unit 200 will be describedin detail below.

The display unit 140 may include a display panel 143 configured tovisually display an image and a display driver 141 configured to drivethe display panel 143.

The display panel 143 may output an image according to image datareceived from the display driver 141.

The display panel 143 may include a pixel, which is a unit of displayingan image. Each pixel may receive an electrical signal indicating imagedata and output an optical signal corresponding to the receivedelectrical signal.

In this manner, optical signals output from a plurality of pixelsincluded in the display panel 143 are combined and thus one image isdisplayed on the display panel 143.

Also, the display panel 143 may be classified as several types accordingto a method in which each pixel outputs an optical signal. For example,the display panel 143 may be classified as a light-emitting display inwhich a pixel itself emits light, a transmissive display configured toblock or transmit light emitted from a backlight or the like, or areflective display configured to reflect or absorb incident light froman external light source.

The display panel 143 may use a cathode ray tube (CRT) display, a liquidcrystal display (LCD) panel, a light emitting diode (LED) panel, anorganic light emitting diode (OLED), a plasma display panel (PDP), afield emission display (FED) panel or the like. However, the displaypanel 143 is not limited thereto, and the display panel 143 may usevarious display methods through which an image corresponding to imagedata can be visually displayed.

The display driver 141 receives image data from the image processingunit 200 according to a control signal of the main control unit 110 anddrives the display panel 143 to display an image corresponding to thereceived image data.

Specifically, the display driver 141 delivers an electrical signalcorresponding to image data to each of the plurality of pixels of thedisplay panel 143.

The display driver 141 may deliver the electrical signal to each of thepixels using various methods in order to deliver the electrical signalto all pixels of the display panel 143 within a short time.

For example, according to an interlace scanning method, the displaydriver 141 may alternately deliver the electrical signal to pixels ofodd-numbered columns and pixels of even-numbered columns among theplurality of pixels.

Also, according to a progressive scanning method, the display driver 141may sequentially deliver the electrical signal to the plurality ofpixels in units of columns.

In this manner, when the display driver 141 delivers the electricalsignal corresponding to image data to each of the pixels of the displaypanel 143, each of the pixels outputs an optical signal corresponding tothe received electrical signal, the optical signals output from thepixels are combined and one image is displayed on the display panel 143.

The sound output unit 150 may output a sound corresponding to sound datawithin the content received by the content receiving unit 130 accordingto the control signal of the main control unit 110. The sound outputunit 150 may include at least one speaker 151 configured to convert anelectrical signal into a sound signal.

The main control unit 110 may include a main processor 111 and a mainmemory 113.

The main memory 113 may store a control program and control data forcontrolling operations of the display device 100, and temporarily storethe user control command received through the input unit 120 or acontrol signal output from the main processor 111.

The main memory 113 may include a volatile memory such as an SRAM or aDRAM and a non-volatile memory such as a flash memory, a read onlymemory (ROM), an erasable programmable read only memory (EPROM) or anelectrically erasable programmable read only memory (EEPROM).

For example, the non-volatile memory may semi permanently store acontrol program and control data for controlling the display device 100.The volatile memory may temporarily store a control program and controldata loaded from the non-volatile memory, the user control commandreceived through the input unit 120 or the control signal output fromthe main processor 111.

Also, the non-volatile memory may be provided separately from thevolatile memory and form an auxiliary memory device of the volatilememory.

The main processor 111 may process various types of data stored in themain memory 113 according to the control program stored in the mainmemory 113.

For example, the main processor 111 may process the user control commandinput through the input unit 120, generate a channel selection signalfor selecting a path through which the content receiving unit 130receives content according to the user control command, and generate avolume control signal for regulating a magnitude of a sound output fromthe sound output unit 150 according to the user control command.

While the main processor 111 and the main memory 113 have beenseparately described above, the present embodiment is not limited to acase in which the main processor 111 and the main memory 113 areprovided as separate chips. The main processor 111 and the main memory113 may be provided as a single chip.

The main control unit 110 may control operations of various componentsincluded in the display device 100 according to a control command of theuser. In particular, the main control unit 110 may control the imageprocessing unit 200 to perform image processing on the image datareceived by the content receiving unit 130 and control the display unit140 to display the image-processed image data.

Hereinafter, a configuration of the image processing unit 200 will bedescribed.

FIG. 3 illustrates an exemplary image processing unit included in adisplay device according to an embodiment.

As described above, the image processing unit 200 includes the graphicprocessor 201 and the graphic memory 203 as hardware components.

Also, the image processing unit 200 may include various image processingmodules as software components. Specifically, the graphic processor 201may perform various image processing operations according to the imageprocessing program and the image processing data stored in the graphicmemory 203. When the image processing unit 200 is divided according tothe image processing operations performed by the graphic processor 201,the image processing unit 200 may include various image processingmodules as illustrated in FIG. 3.

As illustrated in FIG. 3, the image processing unit 200 may include animage reception module 205 configured to receive image data ID andmetadata MD, a linearization module 210 configured to linearize theimage data, a region partitioning module 220 configured to partition animage based on a luminance, a first mapping function generating module231 configured to generate a tone mapping function of a first regionhaving a high luminance, a second mapping function generating module 232configured to generate a tone mapping function of a second region havinga low luminance, a tone mapping module 240 configured to perform tonemapping, and a detail enhancement module 250 configured to perform apost-processing operation on the image on which tone mapping isperformed.

The image reception module 205 receives content C from the contentreceiving unit 130 and outputs the image data ID included in thereceived content C and the metadata MD related to the image data ID.Here, the metadata MD may include information on the image data ID.

The linearization module 210 linearizes the image data ID and outputs alinearized original image I₁.

The region partitioning module 220 receives the original image I₁ fromthe linearization module 210, partitions the received original image I₁into a first region R₁ and a second region R₂, and outputs an image ofthe first region R₁ and an image of the second region R₂.

The first mapping function generating module 231 receives the image ofthe first region R₁ from the region partitioning module 220, andgenerates and outputs a first mapping function MF₁ based on the image ofthe first region R₁.

The second mapping function generating module 232 receives the image ofthe second region R₂ from the region partitioning module 220 andgenerates and outputs a second mapping function MF₂ based on the imageof the second region R₂.

The tone mapping module 240 receives the first mapping function MF₁ andthe second mapping function MF₂ from the first mapping functiongenerating module 231 and the second mapping function generating module232, respectively, and generates a tone mapping function TMF based onthe first mapping function MF₁ and the second mapping function MF₂.

Also, the tone mapping module 240 performs tone mapping on the originalimage I₁ according to the generated tone mapping function TMF andoutputs a first image I₂.

The detail enhancement module 250 receives the first image I₂ from thetone mapping module 240, performs a detail enhancement operation on thereceived first image I₂, and outputs a second image I₃ on which detailenhancement is performed.

The image processing unit 200 receives image data of a high dynamicrange from the content receiving unit 130, generates a display image ofa low dynamic range from the received image data of a high dynamicrange, and delivers the generated display image to the display unit 140.

Hereinafter, operations of respective modules included in the imageprocessing unit 200 will be described.

First, the image reception module 205 will be described.

The image reception module 205 extracts the image data ID and themetadata MD from the content C received by the content receiving unit130.

The content C includes the image data ID representing the original imageand the metadata MD related to the image data ID.

The metadata MD may include luminance information of the image data ID.When the content C is, for example, a video, the metadata MD may includeluminance information of the entire content C, luminance information ofeach scene included in the content C, luminance information of eachframe included in the content C and the like. Here, the frame refers toa single still image forming the video. Also, the scene refers to abundle of a series of frames representing a single condition in a singlebackground. In other words, the scene may be understood as a bundle ofsuccessive frames in which an image is not significantly changed.

Specifically, the metadata MD may include a maximum luminance value, aminimum luminance value and an average luminance value of a plurality ofimages included in the content C. Also, the metadata MD may include amaximum luminance value, a minimum luminance value and an averageluminance value of an image included in each scene. Also, the metadataMD may include a maximum luminance value, a minimum luminance value andan average luminance value of an image forming each frame.

In this manner, the image reception module 205 may extract luminanceinformation of each scene or luminance information of each frame fromthe content C in addition to the image data ID.

Next, the linearization module 210 will be described.

FIG. 4 illustrates an exemplary operation of linearizing image data byan image processing unit included in a display device according to anembodiment. Also, FIG. 5 illustrates an exemplary original image. FIG. 6illustrates a luminance histogram of the original image illustrated inFIG. 5.

As illustrated in FIG. 4, the linearization module 210 linearizes theimage data ID received from the image reception module 205 andcalculates a luminance value of each of the pixels included in thelinearized image.

The image data received by the content receiving unit 130 may bedifferent from an actual image due to various reasons. For example,there may be a difference between an image of an actual imaging targetaccording to an image sensor configured to obtain an image of an imagingtarget and an image according to the image data. Also, during a processin which an image is compressed or encoded in order to transmit or storethe image data, there may be a difference between an initiallytransmitted image and the image according to the image data.

In particular, since a high dynamic range image includes a great amountof information, it is necessary to compress or encode the image in orderto transmit the image via a communication network or store the image ina storage medium.

An original image whose maximum luminance is L₁max and whose minimumluminance is L₁min may be converted into image data whose identifiabledynamic range is N₁ (N₀ to N₁) (in this case, a difference between L₁maxand L₁min is assumed to be a number greater than N₁). For example, anoriginal image whose difference between the maximum luminance L₁max andthe minimum luminance L₁min is 10,000 nits may be compressed to imagedata whose expressible range is 2000 nits.

When the dynamic range of the image decreases, a size of the image datadecreases. However, there is a concern about some pieces of informationincluded in the original image being lost. In this manner, when adynamic range L₁ of the original image is greater than a dynamic rangeN₁ of the image data, a first non-linear mapping function F₁ illustratedin FIG. 4A may be used in order to minimize information that is lostduring the encoding or compressing process.

When the first non-linear mapping function F₁ is used, a regionincluding a great amount of information and a region including a smallamount of information within the original image are compressed atdifferent compression ratios. In other words, in the region including agreat amount of information, an image is compressed at a low compressionratio. In the region including a small amount of information, an imageis compressed at a high compression ratio. Accordingly, it is possibleto increase compression efficiency, and the image data may include agreater amount of information.

The image data ID included in the content C received by the contentreceiving unit 130 may be image data that is nonlinearly compressed bythe first non-linear mapping function F₁ illustrated in FIG. 4A.

The linearization module 210 linearizes the image data that isnonlinearly compressed in this manner.

Specifically, the linearization module 210 may linearize the nonlinearlycompressed image data using a second non-linear mapping function F₂illustrated in FIG. 4B and luminance information of the original imageI₁. Also, the luminance information of the original image I₁ may bereceived from the image reception module 205 described above, theluminance information of the original image I₁ may include a maximumluminance value and a minimum luminance value in units of scenes, or amaximum luminance value and a minimum luminance value in units offrames.

Here, the second non-linear mapping function F₂ may use an inversefunction of the first non-linear mapping function F₁ that is used tocompress the original image to image data.

The first non-linear mapping function F₁ compressing the original imageto image data corresponds to a function that is well-known byinternational standards or the like. Therefore, the linearization module210 may generate the second non-linear mapping function F₂ based on thefirst non-linear mapping function F₁. Also, the second non-linearmapping function F₂ may be stored in the graphic memory 203 in advance.

The image data ID received from the content receiving unit 130 may berestored to the original image by the linearization module 210.

For example, the restored original image may be the original image I₁ asillustrated in FIG. 5.

Also, the linearization module 210 may analyze a luminance of theoriginal image I₁.

Specifically, the linearization module 210 may obtain a maximumluminance value L₁max, a minimum luminance value L₁min and an averageluminance value of the original image I₁.

The linearization module 210 may obtain the maximum luminance valueL₁max, the minimum luminance value L₁min and the average luminance valueof the original image I₁ using various methods.

As described above, the maximum luminance value L₁max, the minimumluminance value L₁min and the average luminance value of the originalimage I₁ may be received from the external device in the form ofmetadata MD of the image data ID.

In this case, the maximum luminance value L₁max, the minimum luminancevalue L₁min and the average luminance value may be provided in units ofcontent C, in units of frames of an image, or in units of scenes of animage. When the value is provided in units of scenes, the linearizationmodule 210 may refer to a maximum luminance value L₁max, a minimumluminance value L₁ min and an average luminance value of a previousframe.

When the metadata MD of the received content C does not include themaximum luminance value L₁max, the minimum luminance value L₁min or theaverage luminance value, the linearization module 210 may directlycalculate the maximum luminance value L₁max, the minimum luminance valueL₁min and the average luminance value from the linearized originalimage.

The linearization module 210 may calculate a luminance value of a pixelincluded in the original image I₁ using Equation 1. Here, each of thepixels of the linearized original image includes a red color value, agreen color value, and a blue color value.L=0.2126R+0.7152G+0.0722B  [Equation 1](where, L denotes a luminance value of a pixel, R denotes a red colorvalue of a pixel, G denotes a green color value of a pixel, and Bdenotes a blue color value of a pixel.)

A luminance value of each of the pixels included in the original imagemay be represented as a luminance histogram. Here, a luminance histogramG₁ of the original image I₁ represents a frequency distribution ofpixels according to the luminance value. That is, an x axis of theluminance histogram G₁ represents a luminance value, and a y axisrepresents the number of pixels corresponding to the luminance value.

For example, the linearization module 210 may represent the originalimage I₁ illustrated in FIG. 5 as the luminance histogram G₁ illustratedin FIG. 6. As illustrated in FIG. 6, in an example of the original imageI₁ illustrated in FIG. 5, the number of pixels having the lowestluminance is the greatest, and the number of pixels decreases as theluminance increases.

The luminance histogram G₁ has been described above to facilitateunderstanding, but this is only an example for facilitatingunderstanding. The image processing unit 200 does not necessarilygenerate the luminance histogram G₁. The image processing unit 200 maygenerate the luminance histogram G₁ as necessary.

Next, the region partitioning module 220 will be described.

FIG. 7 illustrates an example in which the original image illustrated inFIG. 5 is partitioned according to a luminance value of a pixel. FIG. 8illustrates an exemplary image obtained by partitioning the originalimage illustrated in FIG. 5 according to a luminance value. Also, FIG. 9illustrates another exemplary image obtained by partitioning theoriginal image illustrated in FIG. 5 according to a luminance value.

As illustrated in FIGS. 7, 8 and 9, the region partitioning module 220partitions the original image into the first region R₁ and the secondregion R₂ based on a first reference luminance value m according toluminances of the plurality of pixels. Specifically, the regionpartitioning module 220 may partition the original image into a firstregion including pixels whose luminances are equal to or greater thanthe reference luminance value m, and a second region including pixelswhose luminances are less than the first reference luminance value m.

When the luminance histogram G₁ illustrated in FIG. 6 is exemplified,the plurality of pixels of the original image I₁ may be classified aspixels included in the first region R₁ or pixels included in the secondregion R₂ based on the first reference luminance value m as illustratedin FIG. 7.

Here, the first reference luminance value m may be set to the maximumluminance value that can be maximally output from the display device 100or a luminance value smaller than the maximum luminance value.

Also, the first reference luminance value m may be set by the user ormay be a predetermined value.

When the original image I₁ illustrated in FIG. 5 is partitioned into thefirst region R₁ and the second region R₂ according to the firstreference luminance value m, the image may be partitioned into the firstregion R₁ in which a luminance value of a pixel is equal to or greaterthan the first reference luminance value m and the second region R₂ inwhich a luminance value of a pixel is less than the first referenceluminance value m as illustrated in FIG. 8.

Also, the region partitioning module 220 may set a pixel whose luminancevalue is equal to or greater than the first reference luminance value mand a pixel near the pixel whose luminance value is equal to or greaterthan the first reference luminance value m as the first region R₁. Thisis because continuity of the image needs to be maintained after tonemapping is performed.

For example, the region partitioning module 220 may partition theoriginal image I₁ into a plurality of regions as illustrated in FIG. 9A.

Then, the region partitioning module 220 may set regions such that aregion including a pixel whose luminance value is equal to or greaterthan the first reference luminance value m is the first region R₁, and aregion including no pixel whose luminance value is equal to or greaterthan the first reference luminance value m in the partitioned region isthe second region R₂.

When the original image I₁ illustrated in FIG. 5 is partitioned into thefirst region R₁ and the second region R₂ in this manner, the regionpartitioning module 220 may set the pixel whose luminance value is equalto or greater than the first reference luminance value m and the pixelnear the pixel whose luminance value is equal to or greater than thefirst reference luminance value m as the first region R₁ as illustratedin FIG. 9B.

Next, the first mapping function generating module 231 will bedescribed.

FIG. 10 illustrates an example in which the image processing unitillustrated in FIG. 3 extracts a feature point from a first region.Also, FIG. 11 illustrates an example in which the image processing unitillustrated in FIG. 3 generates a first mapping function based on afeature point of a first region. FIG. 12 illustrates another example inwhich the image processing unit illustrated in FIG. 3 generates a firstmapping function according to a feature point of a first region.

As illustrated in FIGS. 10, 11 and 12, the first mapping functiongenerating module 231 generates the first mapping function MF₁ based onthe image of the first region R₁.

Here, the first mapping function MF₁ refers to a parameter function ofconverting the image of the first region R₁ within the original imageI₁, which is the high dynamic range image, into a low dynamic rangeimage. In other words, the image of the first region R₁ is convertedinto the low dynamic range image by the first mapping function MF₁.

Specifically, the first mapping function MF₁ converts the high dynamicrange image whose luminance value ranges between the first referenceluminance value m and a maximum original luminance value L₁max into thelow dynamic range image whose luminance value ranges between a secondreference luminance value n and a maximum display luminance value L₂max.Here, the second reference luminance value n may be set by the user ormay be appropriately set in advance by a designer of the display device100.

The first mapping function generating module 231 extracts pixelsincluding feature information, and generates the first mapping functionMF₁ based on a histogram of the extracted pixels. Here, the featureinformation may include edge information of the image included in thefirst region R₁, texture information of the image and gradationinformation of the image.

The first mapping function generating module 231 may generate the firstmapping function MF₁ for vividly displaying an edge of the first regionR₁, vividly displaying a texture of the image, or vividly displaying agradation of the image.

For example, in order to vividly display an edge region, the firstmapping function generating module 231 may extract a pixel having aluminance value whose difference from that of an adjacent pixel is equalto or greater than a reference value from pixels included in the firstregion R₁. In other words, the first mapping function generating module231 may extract a pixel FP having a luminance value whose differencefrom that of an adjacent pixel is equal to or greater than a referencevalue as illustrated in FIG. 10B from the image of the first region R₁illustrated in FIG. 10A. Here, the pixel having a luminance value whosedifference from that of an adjacent pixel is equal to or greater thanthe reference value may be determined as being positioned at the edgeregion of the image.

Also, the first mapping function generating module 231 may calculate afrequency distribution of pixels (the pixel having a luminance valuewhose difference from that of an adjacent pixel is equal to or greaterthan the reference value) positioned at the edge region.

The frequency distribution of pixels positioned at the edge region maybe represented as an edge histogram G₂ as illustrated in FIG. 11A.Specifically, an x axis of the edge histogram G₂ represents a luminancevalue and a y axis represents the number of pixels having a luminancevalue whose difference from that of an adjacent pixel is equal to orgreater than the reference value.

As illustrated in FIG. 11A, the number of pixels positioned at the edgeregion is the greatest near a luminance value p. In luminance valuesother than near the luminance value p, the number of pixels having aluminance value whose difference from that of an adjacent pixel is equalto or greater than the reference value is small.

In order to vividly display the edge region of the image displayed onthe display device 100, the first mapping function generating module 231may allocate a wide luminance range displayed on the display device 100for a luminance range having the great number of edge region pixels andallocate a narrow luminance range displayed on the display device 100for a luminance range having the small number of edge region pixels.

Specifically, the first mapping function generating module. 231 maygenerate the first mapping function MF₁ in which luminance values atwhich the number of pixels positioned at the edge region is great have alarge gradient and luminance values at which the number of pixelspositioned at the edge region is small have a small gradient asillustrated in FIG. 11B. In particular, in order to generate the firstmapping function MF₁, the first mapping function generating module 231may determine a cumulative edge histogram obtained by integrating theedge histogram G₂ as the first mapping function MF₁.

However, the first mapping function MF₁ generated by the first mappingfunction generating module 231 is not limited thereto.

For example, when an edge histogram G₁ is the same as in FIG. 12A, thefirst mapping function generating module 231 may generate the firstmapping function MF₁ as illustrated in FIG. 12B.

Specifically, the first mapping function generating module 231 maygenerate the first mapping function MF₁ that has a constant gradientabove luminance values at which the number of pixels positioned at theedge region is great as illustrated in FIG. 12B.

As another example, in order to vividly display a texture of the image,the first mapping function generating module 231 may extract a pixel ofa region in which a luminance value is changed within a constant range.The region in which a luminance value is changed within a constant rangemay be determined as a region in which a texture is exhibited.

Also, the first mapping function generating module 231 may calculate afrequency distribution of pixels of the region (a region in which aluminance value is changed within a constant range) in which a textureis exhibited

Also, the first mapping function generating module 231 may generate afirst mapping function in which a large gradient occurs near luminancevalues at which the number of pixels of the region in which a texture isexhibited is great and a small gradient occurs near luminance values atwhich the number of pixels of the region in which a texture is exhibitedis small.

As another example, in order to vividly display a gradation of theimage, the first mapping function generating module 231 may extract apixel of a region in which a luminance value is constantly andcontinuously changed. The region in which a luminance value isconstantly and continuously changed may be determined as a region inwhich a gradation is exhibited.

Also, the first mapping function generating module 231 may calculate afrequency distribution of pixels of the region (the region in which aluminance value is constantly and continuously changed) in which agradation is exhibited.

Also, the first mapping function generating module 231 may generate afirst mapping function in which luminance values at which the number ofpixels of the region in which a gradation is exhibited is great have alarge gradient and luminance values at which the number of pixels of theregion in which a gradation is exhibited is small have a small gradient.

In this manner, the first mapping function generating module 231 maygenerate various first mapping functions MF₁ in order to vividly displayvarious pieces of image information included in the image of the firstregion R₁.

Specifically, in order to vividly display various pieces of imageinformation included in the image of the first region R₁, the firstmapping function generating module 231 may calculate a frequencydistribution of pixels including feature information and generate thefirst mapping function MF₁ based on the generated frequencydistribution.

Next, the second mapping function generating module 232 will bedescribed.

FIG. 13 illustrates an example in which the image processing unitillustrated in FIG. 3 generates a second mapping function based on animage of a second region.

As illustrated in FIG. 13, the second mapping function generating module232 generates the second mapping function MF₂ based on the image of thesecond region R₂.

Here, the second mapping function MF₂ refers to a parameter function ofconverting the image of the second region R₂ within the original imageI₁, which is the high dynamic range image, into the low dynamic rangeimage. In other words, the image of the first region R₁ is convertedinto the low dynamic range image by the second mapping function MF₂.

Specifically, the first mapping function MF₁ converts the high dynamicrange image whose luminance value ranges between a minimum originalluminance value L₁min and the reference luminance value m into the lowdynamic range image whose luminance value ranges between a minimumdisplay luminance value L₂ min and the second reference luminance valuen. Here, the second reference luminance value n may be set by the useror may be appropriately set in advance by a designer of the displaydevice 100, as described above.

Specifically, the second mapping function generating module 232 extractsluminance information of the second region R₂ and generates the secondmapping function MF₂ based on the extracted luminance information.

The luminance information of the second region R₂ may be obtained basedon the luminance histogram G₁ of the original image I₁ as illustrated inFIG. 13A.

The second mapping function generating module 232 may generate thesecond mapping function MF₂ for sufficiently maintaining brightness ofthe image of the second region R₂ and preventing image informationincluded in the image of the second region R₂ from being lost.

For example, the second mapping function generating module 232 mayallocate a wide luminance range displayed on the display device 100 fora luminance region having the great number of pixels and may allocate anarrow luminance range displayed on the display device 100 for aluminance region having the small number of pixels.

Specifically, as illustrated in FIG. 13A, when the number of pixelsdecreases as the luminance value increases, the second mapping functiongenerating module 232 may generate the second mapping function MF₂ inwhich a gradient decreases as the luminance value increases asillustrated in FIG. 13B. In particular, in order to generate the secondmapping function MF₂, the second mapping function generating module 232may generate the second mapping function MF₂ based on a cumulativeluminance histogram obtained by integrating the luminance histogram G₁.

However, the second mapping function MF₂ generated by the second mappingfunction generating module 232 is not limited thereto.

For example, the second mapping function generating module 232 maygenerate a linear tone mapping function, a log tone mapping function orthe like.

The linear tone mapping function converts the high dynamic range imageinto the low dynamic range image such that a luminance value of the highdynamic range image and a luminance value of the low dynamic range imagehave a linear relation.

The linear tone mapping function, which is a tone mapping function ofmaintaining a contrast between pixels, has an advantage in that a visualsense of difference rarely occurs between the original image I₁ and thedisplay image I₂.

The linear tone mapping function converts the high dynamic range imageinto the low dynamic range image such that a luminance value of the highdynamic range image and a luminance value of the low dynamic range imagehave a relation of a log function.

In the log tone mapping function, a characteristic in which human visualcharacteristics which underlie Weber's law increase similarly to a logfunction is used. Weber's law states that a human's eyes sense a slightchange of brightness in a dark region, but cannot easily sense a greatchange of brightness in a bright region.

The log tone mapping function generally increases brightness of theimage according to a characteristic of the log function and has a highcontrast effect in a dark region of the image.

In this manner, the second mapping function generating module 232 maygenerate a second mapping function based on a log function or a secondmapping function based on a zone system.

Next, the tone mapping module 240 will be described.

FIG. 14 illustrates an exemplary tone mapping function generated by theimage processing unit illustrated in FIG. 3. FIG. 15 illustrates aresult obtained when a display device of the related art performs tonemapping on a high dynamic image. FIG. 16 illustrates a result obtainedwhen a display device according to an embodiment performs tone mappingon a high dynamic image.

As illustrated in FIGS. 14, 15 and 16, the tone mapping module 240combines the first mapping function MF₁ with the second mapping functionMF₂, generates a tone mapping function MF₁ and performs tone mapping onthe original image I₁ using the tone mapping function MF.

Here, the tone mapping function MF refers to a parameter function ofconverting the original image I₁, which is the high dynamic range image,into the low dynamic range image. In other words, the original image I₁is converted into the display image I₂, which is the low dynamic rangeimage, according to the tone mapping function MF.

Specifically, the tone mapping function MF converts the original imageI₁, whose luminance value ranges between the minimum original luminancevalue L₁min and the maximum original luminance value L₁max into thedisplay image I₂ whose luminance value ranges between the minimumdisplay luminance value L₂ min and the maximum display luminance valueL₂max.

When the first mapping function MF₁ illustrated in FIG. 11B and thesecond mapping function MF₂ illustrated in FIG. 13B are combined, thetone mapping function MF according to an embodiment illustrated in FIG.14 is generated.

The tone mapping function MF generated in this manner may preservebrightness of the image of the second region R₂, which is a lowluminance region, and preserve feature information of the image of thefirst region R₁, which is a high luminance region.

The tone mapping module 240 may perform tone mapping on the originalimage I₁, and generate the first image I₂. Specifically, the tonemapping module 240 may apply all pixels included in the original imageI₁, to the tone mapping function MF and thus perform tone mapping.

Here, the first image I₂ has a luminance range that is the same as aluminance range that can be output from the display device 100.

In this manner, the tone mapping function MF generated by the tonemapping module 240 that can preserve brightness of the low luminanceregion and feature information of the high luminance region can morevividly display an image in the high luminance region than a tonemapping function MF₃ based on a log function.

For example, when the tone mapping function MF₃ based on a log functionillustrated in FIG. 15A is used to perform tone mapping on the originalimage I₁ illustrated in FIG. 5, the display image I₂ illustrated in FIG.15B is output.

Also, when the tone mapping function MF illustrated in FIG. 16A is usedto perform tone mapping on the original image I₁, illustrated in FIG. 5,the display image I₂ illustrated in FIG. 16B is output.

In the display image I₂ on which tone mapping is performed by the tonemapping function MF₃ based on a log function, the image is not vividlydisplayed in a high luminance region R₁ as illustrated in FIG. 15B. Onthe other hand, in the display image I₂ on which tone mapping isperformed by the tone mapping function MF generated by the tone mappingmodule 240, the image is vividly displayed in a high luminance region R₁as illustrated in FIG. 16B.

Next, the detail enhancement module 250 will be described.

Detail enhancement refers to processing of the image I₂ on which tonemapping is performed in order to provide a further vivid image for theuser.

Such detail enhancement may include various image processing techniquessuch as contrast enhancement through which a difference between a brightregion and a dark region of an image is maximized, histogramequalization through which a histogram is regulated to change an imagehaving a low contrast distribution to an image having a uniform contrastdistribution, image sharpening through which an image is finelyconverted, and image smoothing through which an image is gentlyconverted.

The detail enhancement module 250 may process the first image I₂ usingvarious image processing techniques which are already well-known, andoutput the second image I₃ on which detail enhancement is performed.

In this manner, the image processing unit 200 may partition the originalimage I₁ into the first region R₁, which is a high luminance region, andthe second region R₂, which is a low luminance region, perform tonemapping on the first region R₁ based on characteristics of the imagesuch as an edge of the image, a texture of the image or a gradation ofthe image and perform tone mapping on the second region R₂ based onbrightness of the image.

As a result, the image processing unit 200 may process the originalimage such that the original image I₁, which is the high dynamic rangeimage, is vividly displayed on the display panel 143 having a lowdynamic range.

Hereinafter, operations of the display device 100 according to anembodiment will be described.

FIG. 17 illustrates an exemplary high dynamic range image displayoperation of a display device according to an embodiment;

As illustrated in FIG. 17, the high dynamic range image displayoperation (1000) of the display device 100 will be described.

The display device 100 receives an image from the outside (1010). Thedisplay device 100 may receive content from the outside through thecontent receiving unit 130 and extract the image data ID and themetadata MD included in the received content.

The metadata MD is data including information on the image data ID, andmay include luminance information of units of scenes or luminanceinformation of units of frames. Specifically, the metadata MD mayinclude a maximum luminance value, a minimum luminance value and anaverage luminance value of the entire content C, a maximum luminancevalue, a minimum luminance value and an average luminance value of animage included in each scene or a maximum luminance value, a minimumluminance value and an average luminance value of an image forming eachframe.

The image data ID and the metadata MD are extracted, and then thedisplay device 100 linearizes the received image (1020). The displaydevice 100 may linearize image data in order to obtain the originalimage I₁.

Specifically, the image processing unit 200 of the display device 100may use the second non-linear mapping function F₂ and restore the imagedata to the original image I₁. Also, the image processing unit 200 maycalculate the luminance information of the original image I₁ based on acolor value of each of the pixels included in the restored originalimage I₁.

The image is linearized and then the display device 100 partitions theoriginal image I₁ into a plurality of regions (1030). The display device100 may partition the original image I₁ into the first region R₁, whichis a high luminance region, and the second region R₂, which is a lowluminance region.

Specifically, the image processing unit 200 of the display device 100may partition the original image I₁ into the first region R₁ including apixel whose luminance value is equal to or greater than the referenceluminance value and the second region R₂ including a pixel whoseluminance value is less than the reference luminance value m.

The image is partitioned and then the display device 100 generates thefirst mapping function MF₁ and the second mapping function MF₂ (1040).The display device 100 may generate the first mapping function MF₁ ofthe image of the first region R₁ and the second mapping function MF₂ ofthe image of the second region R₂.

Specifically, the image processing unit 200 of the display device 100may extract a pixel including feature information such as an edge, atexture and a gradation from the image of the first region R₁ andgenerate the first mapping function MF₁ based on a histogram of thepixels including feature information.

Also, the image processing unit 200 may generate the second mappingfunction MF₂ based on the luminance histogram of the image of the secondregion R₂.

After the first and second mapping functions MF₁ and MF₂ are generated,the display device 100 generates the tone mapping function and performstone mapping on the original image I₁ (1050). The display device 100 mayuse the tone mapping function MF in which the first and second mappingfunctions MF₁ and MF₂ are combined and generate the first image I₂ fromthe original image I₁.

Specifically, the image processing unit 200 of the display device 100may combine the first mapping function MF₁ with the second mappingfunction MF₂ and generate the tone mapping function MF. Also, the imageprocessing unit 200 may apply the original image I₁ to the tone mappingfunction MF and generate the first image I₂ from the original image I₁.

The tone mapping is performed and then the display device 100 performsdetail enhancement on the first image I₂ (1060). The display device 100may perform image processing such as contrast enhancement on the firstimage I₂ in order to further vividly display the first image I₂.

Specifically, the image processing unit 200 of the display device 100may perform detail enhancement such as contrast enhancement on the firstimage I₂ and thus generate the second image I₃.

The detail enhancement is performed and then the display device 100displays the image (1070). The display device 100 may display the secondimage I₃ through the display unit 140.

In this manner, the display device 100 may partition the original imageI₁ into the first region R₁, which is a high luminance region, and thesecond region R₂, which is a low luminance region, perform tone mappingbased on characteristics of the image such as an edge, a texture or agradation of the image on the first region R₁, and perform tone mappingon the second region R₂ based on brightness of the image.

As a result, the display device 100 may process the original image I₁such that the original image I₁, which is the high dynamic range image,is vividly displayed on the display panel 143 having a low dynamicrange.

The display device 100 according to the embodiment and an exemplaryconfiguration and operation of the image processing unit 200 includedtherein have been described above.

However, an image processing unit included in the display device 100 isnot limited to the image processing unit 200 illustrated in FIG. 3, butvarious display devices 100 may include various image processing units.

Hereinafter, various image processing units that can be included in thedisplay device 100 according to the embodiment will be described. Thesame configurations as those of the image processing unit 200 describedabove are denoted with like reference numerals.

FIG. 18 illustrates another exemplary image processing unit included ina display device according to an embodiment. FIGS. 19 and 20 illustratean example in which the image processing unit illustrated in FIG. 18generates a tone mapping function.

As illustrated in FIG. 18, an image processing unit 200′ may include theimage reception module 205 configured to receive the image data ID andthe metadata MD, the linearization module 210 configured to linearizethe image data, the region partitioning module 220 configured topartition an image based on a luminance, the first mapping functiongenerating module 231 configured to generate the tone mapping functionof the high luminance region, a tone mapping module 240′ configured toperform tone mapping, and the detail enhancement module 250 configuredto perform a post-processing operation on the image on which tonemapping is performed.

The image reception module 205 extracts the image data ID and themetadata MD from the content C received by the content receiving unit130. Here, the content C includes the image data ID representing theoriginal image and the metadata MD related to the image data ID. Themetadata MD may include luminance information of the image data ID. Whenthe content C is, for example, a video, the metadata MD may include atleast one of luminance information of the entire content C, luminanceinformation of each scene included in the content C, and luminanceinformation of each frame included in the content C.

The linearization module 210 may linearize the image data ID receivedfrom the image reception module 205 and analyze a luminance of thelinearized image. Specifically, when the maximum luminance value L₁max,the minimum luminance value L₁min or the average luminance value is notincluded in the metadata MD of the content C, the linearization module210 may directly calculate the maximum luminance value L₁max, theminimum luminance value L₁min and the average luminance value from thelinearized original image.

The region partitioning module 220 partitions the original image intothe first region R₁ and the second region R₂ based on the firstreference luminance value m according to luminances of the plurality ofpixels. Specifically, the region partitioning module 220 may partitionthe original image into a first region including pixels whose luminancesare equal to or greater than the reference luminance value m, and asecond region including pixels whose luminances are less than the firstreference luminance value m.

The first mapping function generating module 231 extracts pixelsincluding feature information from the first region R₁ and generates thefirst mapping function MF₁ based on a histogram of the extracted pixels.Here, the feature information may include edge information of the imageincluded in the first region R₁, texture information of the image andgradation information of the image.

The tone mapping module 240′ generates the tone mapping function MFbased on the original image I₁ and the first mapping function MF₁ andperforms tone mapping on the original image I₁ using the tone mappingfunction MF.

Here, the tone mapping function MF refers to a parameter function ofconverting the original image I₁, which is the high dynamic range image,into the low dynamic range image. In other words, the original image I₁is converted into the display image I₂, which is the low dynamic rangeimage, by the tone mapping function MF.

First, the tone mapping module 240′ generates a temporary tone mappingfunction MF′ based on the luminance information of the original imageI₁. Here, the temporary tone mapping function MF′ may be used to finallygenerate the tone mapping function MF.

The luminance information of the original image I₁ may be obtained basedon the luminance histogram G₁ of the original image I₁ as illustrated inFIG. 19A.

The tone mapping module 240′ may generate the temporary tone mappingfunction MF′ for sufficiently maintaining brightness of the originalimage I₁ and preventing image information included in the original imageI₁ from being lost.

For example, the tone mapping module 240′ may allocate a wide luminancerange displayed on the display device 100 for a luminance region havingthe great number of pixels and may allocate a narrow luminance rangedisplayed on the display device 100 for a luminance region having thesmall number of pixels.

Specifically, as illustrated in FIG. 19A, when the number of pixelsdecreases as the luminance value increases, the tone mapping module 240′may generate the temporary tone mapping function MF′ in which a gradientdecreases as the luminance value increases as illustrated in FIG. 19B.In particular, in order to generate the temporary tone mapping functionMF,′ the tone mapping module 240′ may determine a cumulative luminancehistogram obtained by integrating the luminance histogram G₁ as thetemporary tone mapping function MF.′

However, the temporary tone mapping function MF′ generated by the tonemapping module 240′ is not limited thereto.

For example, the tone mapping module 240′ may generate a tone mappingfunction based on a log function or a tone mapping function based on azone system, which is already well-known.

The tone mapping module 240′ that has generated the temporary tonemapping function MF′ combines the temporary tone mapping function MF′with the first mapping function MF₁ received from the first mappingfunction generating module 231 and generates the tone mapping functionMF.

The tone mapping module 240′ may combine the temporary tone mappingfunction MF′ with the first mapping function MF₁ using various methods.

For example, the tone mapping module 240′ may synthesize the temporarytone mapping function MF′ of the high luminance region and the firstmapping function MF₁ and generate the tone mapping function MF.

Specifically, the tone mapping module 240′ may perform normalizationsuch that an output of the first mapping function MF₁ has a valuebetween “0” and “1,” synthesize the temporary tone mapping function MF′of the reference luminance value m or more and the normalized firstmapping function MF₁, and thus generate the tone mapping function MF.

As a result, tone mapping is performed on the original image I₁ by thetemporary tone mapping function MF′ and tone mapping may be performedagain on the image included in the first region R₁ within the originalimage I₁ by the first mapping function MF₁.

As another example, the tone mapping module 240′ may replace thetemporary tone mapping function MF′ of the high luminance region withthe first mapping function MF₁. Specifically, the tone mapping module240′ may replace a part of the reference luminance value m or morewithin the temporary tone mapping function MF′ with the first mappingfunction MF₁.

In this case, the tone mapping module 240′ may calculate a luminancevalue I of the low dynamic range corresponding to the referenceluminance value m and scale an output range of the first mappingfunction MF₁ based on a difference between the calculated referenceluminance value I of the low dynamic range and the maximum luminancevalue L₂max of the low dynamic range. Specifically, the tone mappingmodule 240′ may scale the output range of the first mapping function MF₁such that the output of the first mapping function MF₁ ranges betweenthe reference luminance value I of the low dynamic range and the maximumluminance value L₂max of the low dynamic range.

When the temporary tone mapping function MF′ illustrated in FIG. 19B andthe first mapping function MF₁ illustrated in FIG. 11B are combined, thetone mapping function MF illustrated in FIG. 20 may be generated.

The tone mapping function MF generated in this manner may preservebrightness of the original image I₁ and preserve feature information ofthe image of the first region R₁, which is a high luminance region.

The tone mapping module 240′ that has generated the tone mappingfunction MF may perform tone mapping on the original image I₁ using thetone mapping function MF and generate the first image I₂. Specifically,the tone mapping module 240′ may apply all pixels included in theoriginal image I₁ to the tone mapping function MF and thus perform tonemapping.

Here, the first image I₂ has a luminance range that is the same as aluminance range that can be output from the display device 100.

In this manner, the tone mapping function MF generated by the tonemapping module 240′ that can preserve brightness of the low luminanceregion and feature information of the high luminance region can morevividly display an image in the high luminance region than the tonemapping function based on a log function.

The detail enhancement module 250 processes the image I₂ on which tonemapping is performed in order to provide a further vivid image for theuser. Here, detail enhancement may include various image processingtechniques such as contrast enhancement through which a differencebetween a bright region and a dark region of an image is maximized,histogram equalization through which a histogram is regulated to changean image having a low contrast distribution to an image having a uniformcontrast distribution, image sharpening through which an image is finelyconverted, and image smoothing through which an image is gentlyconverted.

Hereinafter, operations of the display device 100 according to anembodiment will be described.

FIG. 21 illustrates another exemplary high dynamic range image displayoperation of a display device according to an embodiment.

As illustrated in FIG. 21, the high dynamic range image displayoperation (1100) of the display device 100 will be described.

The display device 100 receives an image from the outside (1110). Thedisplay device 100 may receive content from the outside through thecontent receiving unit 130 and extract the image data ID and themetadata MD included in the received content.

The metadata MD is data including information on the image data ID, andmay include luminance information of units of scenes or luminanceinformation of units of frames. Specifically, the metadata MD mayinclude a maximum luminance value, a minimum luminance value and anaverage luminance value of the entire content C, a maximum luminancevalue, a minimum luminance value and an average luminance value of animage included in each scene or a maximum luminance value, a minimumluminance value and an average luminance value of an image forming eachframe.

The image data ID and the metadata MD are extracted, and then thedisplay device 100 linearizes the received image (1120). The displaydevice 100 may linearize image data in order to obtain the originalimage I₁.

Specifically, the image processing unit 200 of the display device 100may use the second non-linear mapping function F₂ and restore the imagedata to the original image I₁. Also, the image processing unit 200 maycalculate the luminance information of the original image I₁ based on acolor value of each of the pixels included in the restored originalimage I₁.

The image is linearized and then the display device 100 detects thefirst region from the original image I₁ (1130). The display device 100may detect the first region R₁, which is a high luminance region, fromthe original image I₁.

Specifically, the image processing unit 200 of the display device 100may detect the first region R₁ including a pixel whose luminance valueis equal to or greater than the reference luminance value m from theoriginal image I₁.

The first region R₁ is detected and then the display device 100generates the first mapping function MF₁ (1140). The display device 100may generate the first mapping function MF₁ of the image of the firstregion R₁.

Specifically, the image processing unit 200 of the display device 100may extract a pixel including feature information such as an edge, atexture and a gradation from the image of the first region R₁ andgenerate the first mapping function MF₁ based on a histogram of thepixels including feature information.

After the first mapping function MF₁ is generated, the display device100 generates the tone mapping function and performs tone mapping on theoriginal image I₁ (1150). The display device 100 may generate thetemporary tone mapping function MF′ and generate the first image I₂ fromthe original image I₁ using the temporary tone mapping function MF′ andthe first mapping function MF₁.

Specifically, the image processing unit 200 of the display device 100may generate the temporary tone mapping function MF′ based on theluminance histogram of the original image I₁, combine the temporary tonemapping function MF′ with the first mapping function MF₁ and generatethe tone mapping function MF.

Also, the image processing unit 200 may apply the original image I₁ tothe tone mapping function MF and thus generate the first image I₂ fromthe original image I₁.

The tone mapping is performed and then the display device 100 performsdetail enhancement on the first image I₂ (1160). The display device 100may perform image processing such as contrast enhancement on the firstimage I₂ in order to further vividly display the first image I₂.

Specifically, the image processing unit 200 of the display device 100may perform detail enhancement such as contrast enhancement on the firstimage I₂ and thus generate the second image I₃.

The detail enhancement is performed and then the display device 100displays the image (1170). The display device 100 may display the secondimage I₃ through the display unit 140.

In this manner, the display device 100 may detect the first region R₁from the original image I₁, perform tone mapping on the original imageI₁ based on brightness of the image and then perform tone mapping on thefirst region R₁ based on characteristics of the image such as an edge, atexture or a gradation.

As a result, the display device 100 may process the original image I₁such that the original image I₁, which is the high dynamic range image,is vividly displayed on the display panel 143 having a low dynamicrange.

FIG. 22 illustrates another exemplary image processing unit included ina display device according to an embodiment. Also, FIG. 23 illustratesan example in which the image processing unit illustrated in FIG. 22performs tone mapping on an image of a first region. FIG. 24 illustratesan example in which the image processing unit illustrated in FIG. 22performs tone mapping on an image of a second region. Also, FIG. 25illustrates another exemplary high dynamic range image display operationof a display device according to an embodiment.

As illustrated in FIG. 22, an image processing unit 200″ may include theimage reception module 205 configured to receive the image data ID andthe metadata MD, the linearization module 210 configured to linearizethe image data, the region partitioning module 220 configured topartition an image according to a luminance, a first tone mapping module241 configured to perform tone mapping on the high luminance region, asecond tone mapping module 242 configured to perform tone mapping on thelow luminance region, an image synthesizing module 260 configured tosynthesize the image on which tone mapping is performed, and the detailenhancement module 250 configured to perform a post-processing operationon the image.

The image reception module 205 extracts the image data ID and themetadata MD from the content C received by the content receiving unit130. Here, the content C includes the image data ID representing theoriginal image and the metadata MD related to the image data ID. Themetadata MD may include luminance information of the image data ID. Whenthe content C is, for example, a video, the metadata MD may include atleast one of luminance information of the entire content C, luminanceinformation of each scene included in the content C, and luminanceinformation of each frame included in the content C.

The linearization module 210 may linearize the image data ID receivedfrom the image reception module 205 and analyze a luminance of thelinearized image. Specifically, when the maximum luminance value L₁max,the minimum luminance value L₁min or the average luminance value is notincluded in the metadata MD of the content C, the linearization module210 may directly calculate the maximum luminance value L₁max, theminimum luminance value L₁min and the average luminance value from thelinearized original image.

The region partitioning module 220 partitions the original image intothe first region R₁ and the second region R₂ based on the firstreference luminance value m according to luminances of the plurality ofpixels. Specifically, the region partitioning module 220 may partitionthe original image into a first region including pixels whose luminancesare equal to or greater than the reference luminance value m, and asecond region including pixels whose luminances are less than the firstreference luminance value m.

The first tone mapping module 241 generates the first mapping functionMF₁ based on the image of the first region R₁, and performs tone mappingon the image of the first region R₁ using the first mapping functionMF₁.

Here, the first mapping function MF₁ refers to a parameter function ofconverting the image of the first region R₁, which is the high dynamicrange image, into the low dynamic range image. In other words, the imageof the first region R₁ is converted into the low dynamic range image bythe first mapping function MF₁.

Specifically, the first mapping function MF₁ converts the high dynamicrange image whose luminance value ranges between the first referenceluminance value m and the maximum original luminance value L₁max intothe low dynamic range image whose luminance value ranges between thesecond reference luminance value n and the maximum display luminancevalue L₂max.

The first tone mapping module 241 extracts pixels including featureinformation and generates the first mapping function MF₁ based on ahistogram of the extracted pixels. Here, the feature information mayinclude edge information of the image included in the first region R₁,texture information of the image and gradation information of the image.

For example, in order to vividly display an edge region, the first tonemapping module 241 may extract a pixel having a luminance value whosedifference from that of an adjacent pixel is equal to or greater than areference value from pixels included in the first region R₁ and generatethe first mapping function MF₁ based on a histogram of the extractedpixels.

Also, the first tone mapping module 241 performs tone mapping on theimage of the first region R₁ according to the first mapping function MF₁and generates a first region display image I_(2a).

For example, the first tone mapping module 241 may perform tone mappingon the image of the first region R₁ illustrated in FIG. 8 using thefirst mapping function MF₁ illustrated in FIG. 23A and output the firstregion display image I_(2a) as illustrated in FIG. 23B.

The second tone mapping module 242 generates the second mapping functionMF₂ based on the image of the second region R₂ and performs tone mappingon the image of the second region R₂ using the second mapping functionMF₂.

Here, the second mapping function MF₂ refers to a parameter function ofconverting the image of the second region R₂, which is the high dynamicrange image, into the low dynamic range image. In other words, the imageof the second region R₂ is converted into the low dynamic range image bythe second mapping function MF₂.

Specifically, the second mapping function MF₂ converts the high dynamicrange image whose luminance value ranges between the minimum originalluminance value L₁min and the first reference luminance value m into thelow dynamic range image whose luminance value ranges between the minimumdisplay luminance value L₂ min and the second reference luminance valuen.

The second tone mapping module 242 generates the second mapping functionMF₂ based on a luminance histogram of the image of the second region R₂.Specifically, the second tone mapping module 242 may generate the secondmapping function MF₂ based on a cumulative luminance histogram obtainedby integrating the luminance histogram of the image of the second regionR₂.

However, the present embodiment is not limited thereto. The second tonemapping module 242 may generate the second mapping function MF₂ based ona linear function, a log function or the like.

Also, the second tone mapping module 242 performs tone mapping on theimage of the second region R₂ according to the second mapping functionMF₂ and generates a second region display image I_(2b).

For example, when tone mapping is performed on the image of the secondregion R₂ illustrated in FIG. 8 using the second mapping function MF₂illustrated in FIG. 24A, the second tone mapping module 242 may generatethe second region display image I_(2b) as illustrated in FIG. 24B.

The image synthesizing module 260 synthesizes the first region displayimage I_(2a) received from the first tone mapping module 241 and thesecond region display image I_(2b) received from the second tone mappingmodule 242 and generates the first image I₂.

For example, the image synthesizing module 260 may synthesize the firstregion display image I_(2a) and the second region display image I_(2b)illustrated in FIG. 24B and generate the first image I₂.

In this manner, the first tone mapping module 241 may perform tonemapping using feature information of the high luminance region. Thesecond tone mapping module 242 may perform tone mapping using brightnessinformation of the low luminance region. Also, the image synthesizingmodule may synthesize the first region display image I_(2a) output fromthe first tone mapping module 241 and the second region display imageI_(2b) output from the second tone mapping module 242.

The detail enhancement module 250 processes the image I₂ on which tonemapping is performed in order to provide a further vivid image for theuser. Here, detail enhancement may include various image processingtechniques such as contrast enhancement through which a differencebetween a bright region and a dark region of an image is maximized,histogram equalization through which a histogram is regulated to changean image having a low contrast distribution to an image having a uniformcontrast distribution, image sharpening through which an image is finelyconverted, and image smoothing through which an image is gentlyconverted.

Hereinafter, operations of the display device 100 according to anembodiment will be described.

FIG. 25 illustrates another exemplary high dynamic range image displayoperation of a display device according to an embodiment.

As illustrated in FIG. 25, the high dynamic range image displayoperation (1200) of the display device 100 will be described.

The display device 100 receives an image from the outside (1210). Thedisplay device 100 may receive content from the outside through thecontent receiving unit 130 and extract the image data ID and themetadata MD included in the received content.

The metadata MD is data including information on the image data ID, andmay include luminance information of units of scenes or luminanceinformation of units of frames. Specifically, the metadata MD mayinclude a maximum luminance value, a minimum luminance value and anaverage luminance value of the entire content C, a maximum luminancevalue, a minimum luminance value and an average luminance value of animage included in each scene or a maximum luminance value, a minimumluminance value and an average luminance value of an image forming eachframe.

The image data ID and the metadata MD are extracted, and then thedisplay device 100 linearizes the received image (1120). The displaydevice 100 may linearize image data in order to obtain the originalimage I₁.

Specifically, the image processing unit 200 of the display device 100may use the second non-linear mapping function F₂ and restore the imagedata to the original image I₁. Also, the image processing unit 200 maycalculate the luminance information of the original image I₁ based on acolor value of each of the pixels included in the restored originalimage I₁.

The image is linearized and then the display device 100 partitions theoriginal image I₁ into a plurality of regions (1230). The display device100 may partition the original image I₁ into the first region R₁, whichis a high luminance region, and the second region R₂, which is a lowluminance region.

Specifically, the image processing unit 200 of the display device 100may partition the original image I₁ into the first region R₁ including apixel whose luminance value is equal to or greater than the referenceluminance value m and the second region R₂ including a pixel whoseluminance value is less than the reference luminance value m.

After the image is partitioned, the display device 100 generates thefirst mapping function MF₁ and performs tone mapping on the image of thefirst region R₁ (1240).

The display device 100 may generate the first mapping function MF₁ ofthe image of the first region R₁. Specifically, the image processingunit 200 of the display device 100 may extract a pixel including featureinformation such as an edge, a texture and a gradation from the image ofthe first region R₁ and generate the first mapping function MF₁ based ona histogram related to the pixel including feature information.

Also, the display device 100 may perform tone mapping on the image ofthe first region R₁. Specifically, the image processing unit 200 of thedisplay device 100 may use the first mapping function MF₁, perform tonemapping on the image of the first region R₁, and generate the firstregion display image I_(2a).

Also, the display device 100 generates the second mapping function MF₂and performs tone mapping on the image of the second region R₂ (1250).

The display device 100 may generate the second mapping function MF₂ ofthe image of the second region R₂. Specifically, the image processingunit 200 of the display device 100 may generate the second mappingfunction MF₂ based on a luminance histogram of the second region R₂.

Also, the display device 100 may perform tone mapping on the image ofthe second region R₂. Specifically, the image processing unit 200 of thedisplay device 100 may use the second mapping function MF₂, perform tonemapping on the image of the second region R₂, and generate the secondregion display image I_(2b).

The tone mapping is performed and then the display device 100synthesizes the image on which tone mapping is performed (1260).Specifically, the image processing unit 200 of the display device 100may synthesize the first region display image I₂a and the second regiondisplay image 6 and generate the first image I₂.

Then, the display device 100 performs detail enhancement on the firstimage I₂ (1270). The display device 100 may perform image processingsuch as contrast enhancement on the first image I₂ in order to furthervividly display the first image I₂.

Specifically, the image processing unit 200 of the display device 100may perform detail enhancement such as contrast enhancement on the firstimage I₂ and thus generate the second image I₃.

The detail enhancement is performed and then the display device 100displays the image (1280). The display device 100 may display the secondimage I₃ through the display unit 140.

In this manner, the display device 100 may partition the original imageI₁ into the first region R₁, which is a high luminance region, and thesecond region R₂, which is a low luminance region, perform tone mappingbased on characteristics of the image such as an edge, a texture or agradation of the image on the first region R₁, and perform tone mappingon the second region R₂ based on brightness of the image.

As a result, the display device 100 may process the original image I₁such that the original image I₁, which is the high dynamic range image,is vividly displayed on the display panel 143 having a low dynamicrange.

FIG. 26 illustrates another exemplary image processing unit included ina display device according to an embodiment. FIG. 27 illustrates a thirdmapping function generated by the image processing unit illustrated inFIG. 26.

As illustrated in FIGS. 26 and 27, an image processing unit 200′″ mayinclude the image reception module 205 configured to receive the imagedata ID and the metadata MD, the linearization module 210 configured tolinearize the image data, a third mapping function generating module 233configured to generate a tone mapping function of the high dynamic rangeimage, the tone mapping module 240 configured to perform tone mapping,and the detail enhancement module 250 configured to perform apost-processing operation on the image on which tone mapping isperformed.

The image reception module 205 extracts the image data ID and themetadata MD from the content C received by the content receiving unit130. Here, the content C includes the image data ID representing theoriginal image and the metadata MD related to the image data ID. Themetadata MD may include luminance information of the image data ID. Whenthe content C is, for example, a video, the metadata MD may include atleast one of luminance information of the entire content C, luminanceinformation of each scene included in the content C, and luminanceinformation of each frame included in the content C.

The linearization module 210 may linearize the image data ID receivedfrom the image reception module 205 and analyze a luminance of thelinearized image. Specifically, when the metadata MD of the content Cdoes not include the maximum luminance value L₁max and the minimumluminance value L₁ min, the linearization module 210 may directlycalculate the maximum luminance value L₁max and the minimum luminancevalue L₁min from the linearized original image.

The third mapping function generating module 233 receives the metadataMD from the image reception module 205 and generates a third mappingfunction MF₃ based on the received metadata MD. Here, the metadata MDmay include luminance information of the entire content C, that is, themaximum luminance value L₁max and the minimum luminance value L₁min ofthe entire content C.

Also, the third mapping function MF₃ may be defined between the maximumluminance value L₁max and the minimum luminance value L₁min of thecontent C. In other words, a maximum value input to the third mappingfunction MF₃ is the maximum luminance value L₁max of the content C and aminimum value input to the third mapping function MF₃ is the minimumluminance value L₁min of the content C.

In this manner, by the third mapping function MF₃ generated based on theluminance information of the entire content C, tone mapping may beperformed on the original image I₁ included in the entire content C. Inother words, even if the frame or the scene is changed, when the contentC is not changed, the third mapping function MF₃ is not changed.

The original image I₁ may be classified as a low luminance part or ahigh luminance part based on a third reference luminance value Th. Thelow luminance part and the high luminance part may be differently mappedby the third mapping function MF₃. In other words, a mapping function ofmapping the low luminance part and a mapping function of mapping thehigh luminance part may be different from each other.

In this case, the third reference luminance value Th of the originalimage I₁ may correspond to a target average luminance value Ave_targetof a first image I₂. In other words, the third reference luminance valueTh is mapped to the target average luminance value Ave_target. Theaverage luminance value refers to an average of luminance values outputfrom all pixels included in the display panel 143. The target averageluminance value Ave_target is a target value of the average luminancevalue. Such a target average luminance value Ave_target may be definedin advance according to a type and performance of the display panel 143.

In particular, the third reference luminance value Th of the originalimage I₁ may be the same as a predetermined target average luminancevalue Ave_target of the first image I₂.

The third mapping function MF₃ may include a mapping function MF₃₋₁ ofthe low luminance part and a mapping function MF₃₋₂ of the highluminance part.

The low luminance part whose luminance value is less than the thirdreference luminance value Th may be linearly mapped as illustrated inFIG. 27. In particular, when the third reference luminance value Th isthe same as the target average luminance value Ave_target, a luminancevalue of the low luminance part of the original image I₁ is the same asa luminance value of the low luminance part of the first image I₂.

Specifically, the low luminance part may be mapped by Equation 2.L ₂ =G ₁ L ₁  [Equation 2](where, L₁ denotes a luminance value input to a third mapping function,L₂ denotes a luminance value output from the third mapping function, andG₁ denotes a constant)

In Equation 2, a value of G₁ may be changed according to the thirdreference luminance value Th and the target average luminance valueAve_target. Specifically, G₁ is determined such that the third referenceluminance value Th is mapped to the target average luminance valueAve_target.

In particular, when the third reference luminance value Th is the sameas the target average luminance value Ave_target, G₁ has a value of “1.”

The high luminance part whose luminance value is greater than the thirdreference luminance value Th may be nonlinearly mapped, as illustratedin FIG. 27.

In order to map the high luminance part, Equation 3 may be used.L ₂ =a[1−(L ₁−1)^(2n)]+(1−a)L ₁  [Equation 3](where, L₁ denotes a luminance value input to a third mapping function,L₂ denotes a luminance value output from the third mapping function, anda and n denote a constant.)

In Equation 3, a value of “n” may be determined in advance, and a valueof a may be changed according to the maximum luminance value L₁max andthe minimum luminance value L₁ min of the original image I₁ included inthe entire content C.

The tone mapping module 240 uses the third mapping function MF₃ andperforms tone mapping on the original image I₁.

Specifically, luminance values of all pixels included in the originalimage I₁ are input to the third mapping function MF₃, and the firstimage I₂ is generated based on the luminance value output from the thirdmapping function MF₃. In this case, a pixel whose luminance value isless than the third reference luminance value Th may be mapped byEquation 2, and a pixel whose luminance value is equal to or greaterthan the third reference luminance value Th may be mapped by Equation 3.

The detail enhancement module 250 processes the image I₂ on which tonemapping is performed in order to provide a further vivid image for theuser. Here, detail enhancement may include various image processingtechniques such as contrast enhancement through which a differencebetween a bright region and a dark region of an image is maximized,histogram equalization through which a histogram is regulated to changean image having a low contrast distribution to an image having a uniformcontrast distribution, image sharpening through which an image is finelyconverted, and image smoothing through which an image is gentlyconverted.

Hereinafter, operations of the display device 100 according to anembodiment will be described.

FIG. 28 illustrates another exemplary high dynamic range image displayoperation of a display device according to an embodiment.

As illustrated in FIG. 28, the high dynamic range image displayoperation (1300) of the display device 100 will be described.

The display device 100 receives an image from the outside (1310). Thedisplay device 100 may receive content from the outside through thecontent receiving unit 130 and extract the image data ID and themetadata MD included in the received content.

The metadata MD is data including information on the image data ID, andmay include luminance information of units of scenes or luminanceinformation of units of frames. Specifically, the metadata MD mayinclude a maximum luminance value, a minimum luminance value and anaverage luminance value of the entire content C, a maximum luminancevalue, a minimum luminance value and an average luminance value of animage included in each scene or a maximum luminance value, a minimumluminance value and an average luminance value of an image forming eachframe.

The image data ID and the metadata MD are extracted, and then thedisplay device 100 linearizes the received image (1320). The displaydevice 100 may linearize image data in order to obtain the originalimage I₁.

Specifically, the image processing unit 200 of the display device 100may use the second non-linear mapping function F₂ and restore the imagedata to the original image I₁. Also, the image processing unit 200 maycalculate the luminance information of the original image I₁ based on acolor value of each of the pixels included in the restored originalimage I₁.

The image is linearized and then the display device 100 generates thethird mapping function MF₃ (1330). The display device 100 may generatethe third mapping function MF₃ based on the metadata MD. Specifically,the display device 100 may generate the third mapping function MF₃ basedon the maximum luminance value L₁max and the minimum luminance valueL₁min of the entire content C.

When a luminance value of a pixel included in the original image I₁ isless than the third reference luminance value, the third mappingfunction MF₃ is Equation 2. When a luminance value of a pixel includedin the original image I₁ is equal to or greater than the third referenceluminance value, the third mapping function MF₃ is Equation 3.

The third mapping function MF₃ is generated and then the display device100 performs tone mapping on the original image I₁ (1340).

Specifically, the display device 100 inputs luminance values of allpixels included in the original image I₁ to the third mapping functionMF₃ and generates the first image I₂ based on the luminance value outputfrom the third mapping function MF₃. In this case, when the luminancevalue is less than the third reference luminance value, the pixelincluded in the original image I₁ may be mapped by Equation 2. When theluminance value is equal to or greater than the third referenceluminance value, the pixel included in the original image I₁ may bemapped by Equation 3.

The tone mapping is performed and then the display device 100 performsdetail enhancement on the first image I₂ (1350). The display device 100may perform image processing such as contrast enhancement on the firstimage I₂ in order to further vividly display the first image I₂.

Specifically, the image processing unit 200 of the display device 100may perform detail enhancement such as contrast enhancement on the firstimage I₂ and thus generate the second image I₃.

The detail enhancement is performed and then the display device 100displays the image (1360). The display device 100 may display the secondimage I₃ through the display unit 140.

In this manner, the display device 100 may perform linear tone mappingon the low luminance region of the original image I₁ and nonlinear tonemapping on the high luminance region.

FIG. 29 illustrates another exemplary image processing unit included ina display device according to an embodiment. FIGS. 30 and 31 illustratea fourth mapping function generated by the image processing unitillustrated in FIG. 29

As illustrated in FIGS. 29, 30 and 31, the image processing unit 200″″may include the image reception module 205 configured to receive theimage data ID and the metadata MD, the linearization module 210configured to linearize the image data, a fourth mapping functiongenerating module 234 configured to generate a tone mapping function ofthe high dynamic range image, the tone mapping module 240 configured toperform tone mapping, and the detail enhancement module 250 configuredto perform a post-processing operation on the image on which tonemapping is performed.

The image reception module 205 extracts the image data ID and themetadata MD from the content C received by the content receiving unit130. Here, the content C includes the image data ID representing theoriginal image and the metadata MD related to the image data ID. Themetadata MD may include luminance information of the image data ID. Whenthe content C is, for example, a video, the metadata MD may include atleast one of luminance information of the entire content C, luminanceinformation of each scene included in the content C, and luminanceinformation of each frame included in the content C.

The linearization module 210 may linearize the image data ID receivedfrom the image reception module 205 and analyze a luminance of thelinearized image. Specifically, when the metadata MD of the content Cdoes not include the maximum luminance value L₁max and the minimumluminance value L₁min, the linearization module 210 may directlycalculate the maximum luminance value L₁max and the minimum luminancevalue L₁min from the linearized original image.

The fourth mapping function generating module 234 receives the metadataMD from the image reception module 205 and generates a fourth mappingfunction MF₄ based on the received metadata MD. Here, the metadata MDmay include luminance information of each scene included in the contentC, that is, the maximum luminance value L₁max and the minimum luminancevalue L₁min of each scene.

Also, the fourth mapping function MF₄ may be defined between the maximumluminance value L₁max and the minimum luminance value L₁min of eachscene. In other words, a maximum value input to the fourth mappingfunction MF₄ is the maximum luminance value L₁max of a correspondingscene and a minimum value input to the fourth mapping function MF₄ isthe minimum luminance value L₁min of the corresponding scene.

In this manner, by the third mapping function MF₃ generated based on theluminance information of the scene, tone mapping may be performed on theoriginal image included in the corresponding scene. In other words, evenif the frame is changed, when the scene is not changed, the fourthmapping function MF₄ is not changed. However, even if the content C isnot changed, when the scene is changed, the fourth mapping function MF₄is changed.

The fourth mapping function MF₄ may be changed according to a sceneaverage luminance value Ave_scene indicating an average luminance valueof the entire scene. Also, the original image I₁ may be classified as alow luminance part or a high luminance part. The low luminance part andthe high luminance part may be differently mapped by the fourth mappingfunction MF₄. In other words, a mapping function of mapping the lowluminance part and a mapping function of mapping the high luminance partmay be different from each other.

First, the fourth mapping function MF₄ when the scene average luminancevalue Ave_scene is less than a fourth reference luminance value Th willbe described.

The fourth mapping function MF₄ may include a mapping function MF₄₋₁ ofthe low luminance part of the original image I₁ and a mapping functionMF₄₋₂ of the high luminance part of the original image I₁.

In this case, the low luminance part and the high luminance part of theoriginal image I₁ may be divided based on the fourth reference luminancevalue. Th. Also, the fourth reference luminance value Th of the originalimage I₁ may correspond to the target average luminance value Ave_targetof the first image I₂. In other words, the fourth reference luminancevalue Th is mapped to the target average luminance value Ave_target. Theaverage luminance value refers to an average of luminance values outputfrom all pixels included in the display panel 143. The target averageluminance value Ave_target is a target value of the average luminancevalue. Such a target average luminance value Ave_target may be definedin advance according to a type and performance of the display panel 143.In particular, the fourth reference luminance value Th of the originalimage I₁ may be the same as a predetermined target average luminancevalue Ave_target of the first image I₂.

The low luminance part whose luminance value is less than the fourthreference luminance value Th may be linearly mapped as illustrated inFIG. 30. In particular, when the fourth reference luminance value Th isthe same as the target average luminance value Ave_target, the luminancevalue of the low luminance part of the original image I₁ is the same asthe luminance value of the low luminance part of the first image I₂.

Specifically, the low luminance part may be mapped by Equation 2.L ₂ =G ₁ L ₁  [Equation 2]

(where, L₁ denotes a luminance value input to a fourth mapping function,L₂ denotes a luminance value output from the fourth mapping function andG₁ is a constant.)

In Equation 2, a value of G₁ may be changed according to the fourthreference luminance value Th and the target average luminance valueAve_target. Specifically, G₁ is determined such that the fourthreference luminance value Th is mapped to the target average luminancevalue Ave_target.

In particular, when the fourth reference luminance value Th is the sameas the target average luminance value Ave_target, G₁ has a value of “1.”

The high luminance part whose luminance value is equal to or greaterthan the fourth reference luminance value Th may be nonlinearly mappedas illustrated in FIG. 30.

The high luminance part may be mapped by Equation 3.

In this manner, when the scene average luminance value Ave_scene is lessthan the fourth reference luminance value Th, the fourth mappingfunction MF₄ generated by the fourth mapping function generating module234 is Equation 2 when the luminance value of the pixel included in theoriginal image I₁ is less than the fourth reference luminance value Th,or is Equation 3 when the luminance value of the pixel included in theoriginal image I₁ is equal to or greater than the fourth referenceluminance value Th.

Next, the fourth mapping function MF₄ when the scene average luminancevalue Ave_scene is equal to or greater than the fourth referenceluminance value Th will be described.

The fourth mapping function MF₄ may include the mapping function MF₄₋₁of the low luminance part of the original image I₁ and the mappingfunction M_(F4-2) of the high luminance part of the original image I₁.

In this case, the low luminance part and the high luminance part of theoriginal image I₁ are divided based on the scene average luminance valueAve_scene. Also, the scene average luminance value Ave_scene of theoriginal image I₁ may correspond to the target average luminance valueAve_target of the first image I₂. In other words, the scene averageluminance value Ave_scene is mapped to the target average luminancevalue Ave_target. The average luminance value refers to an average ofluminance values output from all pixels included in the display panel143. The target average luminance value Ave_target is a target value ofthe average luminance value. Such a target average luminance valueAve_target may be defined in advance according to a type and performanceof the display panel 143.

The low luminance part whose luminance value is less than the sceneaverage luminance value Ave_scene may be linearly mapped as illustratedin FIG. 31.

Specifically, the low luminance part may be mapped by Equation 5.L ₂ =G ₂ L ₁  [Equation 5]

(where, L₁ denotes a luminance value input to a fourth mapping function,L₂ denotes a luminance value output from the fourth mapping function,and G₂ is a constant.)

In Equation 5, a value of G₂ may be changed according to the sceneaverage luminance value Ave_scene and the target average luminance valueAve_target. Specifically, G₂ is determined such that the scene averageluminance value Ave_scene is mapped to the target average luminancevalue Ave_target.

In particular, when the scene is changed, since the scene averageluminance value Ave_scene is changed, G₂ may be changed whenever thescene is changed.

The high luminance part whose luminance value is equal to or greaterthan the scene average luminance value Ave_scene may be nonlinearlymapped as illustrated in FIG. 31.

The high luminance part may be mapped by Equation 6.L ₂ =a[1−(L ₁−1)^(2n)]+(1−a)L ₁  [Equation 6]

(where, L₁ denotes a luminance value input to a fourth mapping function,Ave_target denotes a target average luminance value, L₂ denotes aluminance value output from the fourth mapping function, Ave_scenedenotes a scene average luminance value, and a and n are constants.)

In Equation 6, a value of n may be determined in advance, and a value ofa may be determined according to the maximum luminance value L₁max andthe minimum luminance value L₁min of the original image I₁ included ineach scene.

In this manner, when the scene average luminance value Ave_scene isequal to or greater than the fourth reference luminance value Th, thefourth mapping function MF₄ generated by the fourth mapping functiongenerating module 234 is Equation 5 when the luminance value of thepixel included in the original image I₁ is less than the scene averageluminance value Ave_scene, or is Equation 6 when the luminance value ofthe pixel included in the original image I₁ is equal to or greater thanthe scene average luminance value Ave_scene.

The tone mapping module 240 performs tone mapping on the original imageI₁ using the fourth mapping function MF₄.

Specifically, the tone mapping module 240 inputs luminance values of allpixels included in the original image I₁ to the fourth mapping functionMF₄ and generates the first image I₂ based on the luminance value outputfrom the fourth mapping function MF₄.

In this case, when the scene average luminance value Ave_scene is lessthan the fourth reference luminance value Th, a pixel whose luminancevalue is less than the third reference luminance value Th may be mappedby Equation 2, and a pixel whose luminance value is equal to or greaterthan the third reference luminance value Th may be mapped by Equation 3.

Also, when the scene average luminance value Ave_scene is equal to orgreater than the fourth reference luminance value Th, a pixel whoseluminance value is less than the scene average luminance value Ave_scenemay be mapped by Equation 5, and a pixel whose luminance value is equalto or greater than the scene average luminance value Ave_scene may bemapped by Equation 6.

The detail enhancement module 250 processes the image I₂ on which tonemapping is performed in order to provide a further vivid image for theuser. Here, detail enhancement may include various image processingtechniques such as contrast enhancement through which a differencebetween a bright region and a dark region of an image is maximized,histogram equalization through which a histogram is regulated to changean image having a low contrast distribution to an image having a uniformcontrast distribution, image sharpening through which an image is finelyconverted, and image smoothing through which an image is gentlyconverted.

Hereinafter, operations of the display device 100 according to anembodiment will be described.

FIG. 32 illustrates another exemplary high dynamic range image displayoperation of a display device according to an embodiment.

As illustrated in FIG. 32, the high dynamic range image displayoperation (1400) of the display device 100 will be described.

The display device 100 receives an image from the outside (1210). Thedisplay device 100 may receive content from the outside through thecontent receiving unit 130 and extract the image data ID and themetadata MD included in the received content.

The metadata MD is data including information on the image data ID, andmay include luminance information of units of scenes or luminanceinformation of units of frames. Specifically, the metadata MD mayinclude a maximum luminance value, a minimum luminance value and anaverage luminance value of the entire content C, a maximum luminancevalue, a minimum luminance value and an average luminance value of animage included in each scene or a maximum luminance value, a minimumluminance value and an average luminance value of an image forming eachframe.

The image data ID and the metadata MD are extracted, and then thedisplay device 100 linearizes the received image (1420). The displaydevice 100 may linearize image data in order to obtain the originalimage I₁.

Specifically, the image processing unit 200 of the display device 100may use the second non-linear mapping function F₂ and restore the imagedata to the original image I₁. Also, the image processing unit 200 maycalculate the luminance information of the original image I₁ based on acolor value of each of the pixels included in the restored originalimage I₁.

The image is linearized and then the display device 100 generates thefourth mapping function MF₄ (1330). The display device 100 may generatethe fourth mapping function MF₄ based on the metadata MD. Specifically,the display device 100 may generate the fourth mapping function MF₄based on the maximum luminance value L₁max, the minimum luminance valueL₁min and the scene average luminance value Ave_scene of each scene.

Specifically, when the scene average luminance value Ave_scene is lessthan the fourth reference luminance value Th, the fourth mappingfunction MF₄ is Equation 2 when the luminance value of the pixelincluded in the original image I₁ is less than the fourth referenceluminance value Th, or is Equation 3 when the luminance value of thepixel included in the original image I₁ is equal to or greater than thefourth reference luminance value Th.

When the scene average luminance value Ave_scene is equal to or greaterthan the fourth reference luminance value Th, the fourth mappingfunction MF₄ is Equation 5 when the luminance value of the pixelincluded in the original image I₁ is less than the scene averageluminance value Ave_scene, or is Equation 6 when the luminance value ofthe pixel included in the original image I₁ is equal to or greater thanthe scene average luminance value Ave_scene.

The fourth mapping function MF₄ is generated and then the display device100 performs tone mapping on the original image I₁ (1440).

Specifically, the display device 100 inputs luminance values of allpixels included in the original image I₁ to the fourth mapping functionMF₄ and generates the first image I₂ based on the luminance value outputfrom the fourth mapping function MF₄.

In this case, when the scene average luminance value Ave_scene is lessthan the fourth reference luminance value Th, a pixel whose luminancevalue is less than the third reference luminance value Th may be mappedby Equation 2, and a pixel whose luminance value is equal to or greaterthan the third reference luminance value Th may be mapped by Equation 3.

Also, when the scene average luminance value Ave_scene is equal to orgreater than the fourth reference luminance value Th, a pixel whoseluminance value is less than the scene average luminance value Ave_scenemay be mapped by Equation 5, and a pixel whose luminance value is equalto or greater than the scene average luminance value Ave_scene may bemapped by Equation 6.

The tone mapping is performed and then the display device 100 performsdetail enhancement on the first image I₂ (1450). The display device 100may perform image processing such as contrast enhancement on the firstimage I₂ in order to further vividly display the first image I₂.

Specifically, the image processing unit 200 of the display device 100may perform detail enhancement such as contrast enhancement on the firstimage I₂ and thus generate the second image I₃.

The detail enhancement is performed and then the display device 100displays the image (1460). The display device 100 may display the secondimage I₃ through the display unit 140.

In this manner, the display device 100 may perform linear tone mappingon the low luminance region of the original image I₁ and nonlinear tonemapping on the high luminance region.

Although a few embodiments have been shown and described, it would beappreciated by those skilled in the art that changes may be made inthese embodiments without departing from the principles and spirit ofthe embodiments, the scope of which is defined in the claims and theirequivalents.

What is claimed is:
 1. A display device, comprising: a content receiverconfigured to receive a high dynamic range image and luminanceinformation of the high dynamic range image; an image processorconfigured to perform tone mapping based on the luminance information toconvert the high dynamic range image into a low dynamic range image, theluminance information including an image maximum luminance value and animage minimum luminance value of the high dynamic range image; and adisplay configured to display the low dynamic range image, wherein theimage processor is configured to: identify whether a scene averageluminance value of the high dynamic range image included in a scene isgreater than or equal to a reference luminance value, identify whetherto perform linear tone mapping on a first pixel whose luminance value isless than the scene average luminance value among a plurality of pixelsincluded in the high dynamic range image based on whether the sceneaverage luminance value is identified to be greater than or equal to thereference luminance value, identify whether to perform nonlinear tonemapping on a second pixel whose luminance value is greater than or equalto the scene average luminance value among the plurality of pixels basedon whether the scene average luminance value is identified to be greaterthan or equal to the reference luminance value.
 2. The display deviceaccording to claim 1, wherein the luminance information includes a scenemaximum luminance value and a scene minimum luminance value of the highdynamic range image included in the scene.
 3. The display deviceaccording to claim 1, wherein the luminance information includes a framemaximum luminance value and a frame minimum luminance value of the highdynamic range image included in a frame.
 4. The display device accordingto claim 1, wherein the luminance information includes a content maximumluminance value and a content minimum luminance value of the highdynamic range image included in an entire content.
 5. The display deviceaccording to claim 1, wherein the image processor detects a first regionwhere a luminance value is greater than or equal to a referenceluminance value for the high dynamic range image, and performs tonemapping on a region image of the first region based on featureinformation of the region image of the first region, and wherein thefeature information includes at least one of edge information, textureinformation and gradation information.
 6. The display device accordingto claim 5, wherein the image processor detects an edge region withinthe region image of the first region and generates a first mappingfunction based on a histogram of pixels included in the edge region. 7.The display device according to claim 6, wherein the first mappingfunction has a gradient that is changed according to a number of pixelsincluded in the edge region.
 8. The display device according to claim 7,wherein, in the first mapping function, a gradient of luminance valuesat which the number of pixels included in the edge region is a firstvalue is greater than a gradient of luminance value at which the numberof pixels included in the edge region is a second value smaller that thefirst value.
 9. The display device according to claim 6, wherein thefirst mapping function is a cumulative histogram obtained by integratinga histogram of pixels included in the edge region.
 10. The displaydevice according to claim 5, wherein the image processor detects atexture region within the region image of the first region and generatesa first mapping function based on a histogram of pixels included in thetexture region.
 11. The display device according to claim 5, wherein theimage processor detects a gradation region within the region image ofthe first region and generates a first mapping function based on ahistogram of pixels included in the gradation region.
 12. The displaydevice according to claim 5, wherein the image processor generates asecond mapping function based on a luminance value of the high dynamicrange image.
 13. The display device according to claim 12, wherein theimage processor performs second function tone mapping according to thesecond mapping function on the high dynamic range image to produce atone mapped image, and performs first function tone mapping according tothe first mapping function on the tone mapped image on which the secondtone mapping is performed.
 14. The display device according to claim 5,wherein the image processor generates a second mapping function based ona luminance value of a second region whose luminance value is less thanthe reference luminance value within the high dynamic range image. 15.The display device according to claim 14, wherein the image processorgenerates a tone mapping function based on the first mapping functionand the second mapping function, and converts the high dynamic rangeimage into the low dynamic range image according to the tone mappingfunction.
 16. The display device according to claim 1, wherein, when thescene average luminance value of the high dynamic range image includedin the scene is identified to be less than the reference luminancevalue, the image processor performs linear tone mapping on the firstpixel whose luminance value is less than the reference luminance valueamong the plurality of pixels included in the high dynamic range imageand performs nonlinear tone mapping on the second pixel whose luminancevalue is greater than or equal to the reference luminance value amongthe plurality of pixels.
 17. A method of controlling a display device,comprising: receiving a high dynamic range image and luminanceinformation of the high dynamic range image; performing tone mappingbased on the luminance information to convert the high dynamic rangeimage into a low dynamic range image, the luminance informationincluding an image maximum luminance value and an image minimumluminance value of the high dynamic range image; and displaying the lowdynamic range image, and wherein the performing of the tone mappingincludes: identifying whether a scene average luminance value of thehigh dynamic range image included in a scene is greater than or equal toa reference luminance value, identifying whether to perform linear tonemapping on a first pixel whose luminance value is less than the sceneaverage luminance value among a plurality of pixels included in the highdynamic range image based on whether the scene average luminance valueis identified to be greater than or equal to the reference luminancevalue, identifying whether to perform nonlinear tone mapping on a secondpixel whose luminance value is greater than or equal to the sceneaverage luminance value among the plurality of pixels based on whetherthe scene average luminance value is identified to be greater than orequal to the reference luminance value.
 18. The method according toclaim 17, wherein the luminance information includes a scene maximumluminance value and a scene minimum luminance value of the high dynamicrange image included in a scene.
 19. The method according to claim 17,wherein the luminance information includes a frame maximum luminancevalue and a frame minimum luminance value of the high dynamic rangeimage forming a frame.
 20. The method according to claim 17, wherein theluminance information includes a content maximum luminance value and acontent minimum luminance value of the high dynamic range image includedin an entire content.
 21. The method according to claim 17, wherein theperforming tone mapping includes: detecting a first region where aluminance value is greater than or equal to a reference luminance valuefor the high dynamic range image, generating a tone mapping functionbased on feature information of a region image of the first region; andperforming tone mapping on the high dynamic range image according to thetone mapping function to convert the high dynamic range image into thelow dynamic range image, and wherein the feature information includes atleast one of edge information, texture information and gradationinformation of the high dynamic range image.